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ABSTRACT 


The  paper  is  basically  a  discussion  and  survey  of  some 
literature  concerning  the  concept  of  a  distance  function  for  random 

V 

variables  and  point  processes.  Work  of  Kalzanov  on  the  closeness  of 
renewal  processes  to  Poisson  processes  is  outlined,  and  there  are 
comments  on  various  possible  comparison  methods  for  point  processes 
as  given  by  Whitt. 


Keywords :  Point  processes,  renewal  processes,  distance  functions, 
metrics,  comparability  of  processes. 

DISTRIBUTION  STA?5cilT  A 

Approved  for  public  r*loaae; 
Dirtrihution  Unttmitod 


Research  done  whilst  a  visitor  in  the  Department  of  Statistics, 
University  of  North  Carolina,  Chapel  Hill,  and  supported  by  the 
Office  of  Naval  Research  under  Contract  N00014-75-C-0809 . 


1 


INTRODUCTION 


When  art.'  two  point  processes  close  to  one  another?  Indeed, 
when  are  two  stochastic  processes  close  to  one  another?  These  notes 
are  basically  intended  as  a  review  of  some  of  the  literature  concerning 
t ho  proximity  of  one  point  process  to  another,  and  necessarily  therefore 
also  includes  notions  of  one  point  process  being  in  some  sense  larger 
or  thicker  than  another. 

Since  part  of  the  difficulty  in  defining  the  distance 
between  point  processes  may  be  seen  in  defining  the  distance  between 
two  random  variables  (as  distinct  from  processes,  which  are  indexed 
I  ami  lies  of  random  variables),  we  start  with  some  ideas  related  to  the 


distance  of  two  random  variables,  then  review  some  work  of  Kalzanov  /.  -"Op 

/  *°h 

measuring  the  closeness  of  a  stationary  renewal  process  to  a  Poisson/  . 

/  (/■.  "  ti,  '  •*’* 

/  r  '  '• 

process,  proceed  to  ideas  of  comparison  of  point  processes,  and  /  , 

finally  come  to  a  (brief)  section  covering  some  ideas  on  distance/ 
functions  for  point  processes.  /  4,, 

A  ■■ ' 

/  -  i  ;  -  .. 


2.  DISTANCE  BETWEEN  RANDOM  VARIABLES 


The  distance  between  two  points  in  d-dimensional  Euclidean 
space  Rl*  is  a  familiar  enough  idea,  so  that  the  distance  between 
realizations  of  two  R^-valued  random  variables  (r.v.s)  X  and  Y  , 
defined  on  some  common  probability  space  (U,F,P)  say,  is  sensibly 
given  by 


I  X(oj)  -  Y(u>) 


2 


for  each  oj  in  Si  ,  with  j*|  here  denoting  the  usual  distance 
function  in  .  As  soon  as  we  move  away  from  just  realizations 

of  two  r.v.s  and  seek  to  measure  the  closeness  or  otherwise  of  the 
r.v.s  per  se,  by  which  we  mean  the  measurable  functions  X  ,  Y 
mapping  C  into  R^  ,  we  are  forced  either  to  perform  some 
operation  on  the  random  function  |X(u))  -  Y(w)|  ,  or  else  to  have 
recourse  to  some  other  notion  not  necessarily  related  to  the 
distance  of  the  realizations  of  the  two  functions  involved. 

Clearly  the  function 

d  (X,Y)  .  /  |  X(io)  -  Y(u>)  |P(du>)  (2.2) 

a 

is  an  obvious  candidate  for  measuring  the  distance  between  the  r.v.s 
X  and  Y  .  Provided  the  r.v.s  X  and  Y  have  been  given,  and 
that  d_(X,Y)  <  ,  the  definition  (2.2)  is  not  easily  disputed. 

However,  it  is  not  uncommon  to  be  given  not  two  r.v.s  X  and  Y 
but  their  distributions  in  R^  :  for  the  present  it  will  be  enough 

to  consider  the  case  of  the  distribution  functions  (d.f.s)  F  and 
C  of  R^-valued  r.v.s,  so  that  for  example  F(t)  =  P{X  < t}  .  One 
metric  on  the  space  of  d.f.s  with  finite  first  moment  is  the  function 

on 

ddf(F,C)  /  | F ( t )  -  G(t) |dt  .  (2.3) 

— uo 

Manipulation  shows  that  dJt(F,G)  =  d„(X*,Y*)  for  the  r.v.s  X*  and 

dt  fc 

Y*  ,  with  d.f.s  F  and  G  respectively,  defined  by 

X*(io)  =  F_1  (U(w) )  ,  Y*(w)  =  G_1  (U(to) )  (2.4) 

where  F  *  and  G  ^  are  the  functional  inverses  of  the  d.f.s  F 
and  G  ,  and  U(w)  is  a  r.v.  on  (12,F,P)  with  the  uniform 
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distribution,  so  that  P{U(ai)  stl  =  t  for  0  <  t  <  1  .  Thus,  (2.3) 
may  be  expressed  as 

1  1  -1 

ddf(F,G)  =  d£(X*,Y*)  =  /  | F  (u)  -  G  (u) |du  .  (2.5) 

When  the  d.f.s  F  and  G  are  partially  ordered  in  the 

distributional  sense,  F  G  ,  meaning  that  F(t)  >  G(t)  (all  t  in  R) , 

then  X*  <  Y*  ,  and  hence 
a .  s . 


d  f(F,G)  =  | EX  -  EY |  =  EY  -  EX  . 

If  F  and  G  cannot  be  ordered  in  this  way,  or  if  the  pair  (X,Y) 
of  r.v.s  is  not  equivalent  in  distribution  to  (X*,Y*)  ,  then 
dp(X,Y)  also  includes  some  measure  of  the  dispersion  of  X  and  Y  . 

For  example,  when  F  and  G  are  normal  d.f.s  with  zero  mean  and 

2  k 

variances  1  and  a  <  1  ,  d  (X*,Y*)  =  (l-o)  (2/tt)  .  At  the  opposite 

t 

extreme  from  (X*,Y*)  =  (F  ^(U(u))),  G  *(U(go)))  is  the  pair 
(F  1(U(co)),  G  *(1-U(u))))  ,  for  which  it  may  be  shown  that 

1  1  1 

/  |F  (u)  -  G_i (1-u) 1 du  =  2E|Z-£| 

0 


=  E|X-£|+  E|Y-C|  (2.6) 

where  the  r.v.  Z  has  *s(F(t)  +  G(t))  as  its  d.f.  and  £  is  a 

median  of  Z  .  Intermediate  between  (2.6)  and  (2.5),  when  X  and 

Y  are  independently  distributed  r.v.s  with  d.f.s  F  and  G  , 

E | X-Y |  again  vanishes  (like  (2.6)  but  unlike  (2.5))  if  and  only  if 

X  =  Y  =  constant  a.s.:  (2.5)  vanishes  if  and  only  if  X  ^  Y  . 

A  major  difficulty  in  extending  the  definition  d£  or 

d.,  to  R^-valued  r.v.s,  relates  to  the  need  of  an  analogue  of  the 
d  f 

construction  of  (X*,Y*)  .  Consider  the  following  (cf.  also  Daley 


(1981)) . 
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2 

I’robU-ni  1.  Define  R  -valued  r.v.s  X  =  (X^.X^)  and  Y  =  (Y^ 
distributed  uniformly  over  a  circle  of  unit  area  with  centre  at  the 
origin,  and  a  square  of  unit  area  with  centre  at  the  origin, 
respectively.  Amongst  all  r.v.s  with  these  two  specified  distributions, 
is  there  a  construction  of  r.v.s  X*  ,  Y*  such  that 

d,,(X*,Y*)  <  d£(X, Y)  ? 

A  strategy  that  avoids  the  sample  path  problem,  given  two 
distributions,  is  the  use  of  metrics  on  the  distributions  on  the 
state  space  of  the  realizations  induced  by  the  r.v.s.  Thus  we  have 
the  variation  metric 

VF,G)  ^  /  lF(dt)  -  G<dt>  I  (2-7) 

Rd 

for  Revalued  r.v.s  with  distributions  F  and  G  ,  and  in  particular, 
for  Integer-valued  r.v.s  X  and  Y  , 

d  (X,Y)  =  4  I  | P { X= i >  -  P{Y=1 }  |  , 

1 

=  P{X+  /Y  +  }  (2.8) 

"f*  f* 

lor  appropriately  defined  r.v.s  (X  ,Y  )  (and  this  construction  is 
in  general  different  from  (X*,Y*)).  Also,  for  real-valued  r.v.s 
X  and  Y  ,  we  have  the  supremum  metric 

d  (X,  Y)  sup  |  P{X  r  t}  -  P{Y<t}|  ,  (2.9) 

sup  t 

thi'  Levy  metric  and  others. 


\ 
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3_. _ DISTANCE  BETWEEN  POINT  PROCESSES:  INTRODUCTORY  COMMENTS 

Realizations  of  point  processes  on  R  can  be  described 
either  as  counting  measures  or  by  the  distances  of  the  nearest  point 
to  the  right  of  the  origin  and  by  the  lengths  of  the  intervals 
between  successive  points  enumerated  respectively  on  each  side  of 
that  point.  For  the  present  discussion  we  confine  attention  to 
point  processes  on  R+  =  (0,°°)  ,  and  assume  without  essential  loss 
of  generality  that  every  realization  has  N(R+)  >  1  where  N  denotes 
the  counting  measure.  We  use  N  ,  ,  Nj  ,  . . .  as  generic  names  of 

point  processes.  The  two  descriptions  referred  to  above  are  related 
via 


SQ  =  0  ,  Sn  =  inf  { t :  N(0,t]  >n}  ,  (3.1) 

and  X  =  S  -  S  ,  (n  =  1,2,...):  X,  is  the  forward  recurrence 
n  n  n-1  1 

time  interval,  and  (X  :  n  =  2,3,...}  the  successive  intervals 

n 

between  points  so  long  as  <  °°  ;  otherwise  we  may  set  X^  =  °°  . 

Given  two  point  processes  (i  =  1,2)  ,  with  intervals 

1 X  ■  (i=l)  and  {Y  }  (i=2)  ,  the  discussion  of  section  2  leads 

n  n 

to  consideration  as  "natural"  distance  functions  for  and 

either  functions  of  |N^(t)  -  ^(t)!  ,  or  else  of  the  sequence 

{ X^  -  Y^}  .  The  simplest  constructions  of  point  processes  usually 

proceed  via  interval  properties  rather  than  counting  properties 

(though  as  a  counter-example  of  this  conventional  construction, 

recall  Lewis  and  Shedler's  (1979)  discussion  on  realizations  of 

inhomogeneous  Poisson  processes) .  Accordingly,  the  distance  of 

N,  and  N„  may  be  studied  via  functionals  of  {X*-Y*}  where  the 
1  2  J  n  n 

elements  (X*,Y*)  are  constructed  successively  from  the  sequence 
n  n 


-  6  - 


{U*}  of  independent  identically  distributed  (i.i.d.)  r.v.s  uniformly 
n 

distributed  on  (0,1)  .  Such  a  construction  for  renewal  processes 
Nj  is  sensible,  and  also  for  point  processes  whose  intervals  are 
stochastically  monotone  Markov  chains  or  even  certain  semi-Markov 
processes  (see  Sonderman  (1980)).  However,  when  the  successive 
members  of  the  sequence  {X^}  are  not  monotonically  dependent  on 
their  predecessors,  there  may  not  necessarily  exist  a  mapping 
linking  { X* }  and  {Y*}  that  is  unequivocally  the  optimum  one. 

4.  THE  MARGINAL  COUNTING  DISTRIBUTIONS 

Let  be  a  stationary  renewal  process  for  which 

E  N^(0,1]  =  X  and  the  lifetime  d.f.  is  F  ,  so  that  {Xr:  n  =  2,3,...} 
are  i.i.d.  r.v.s  with  d.f.  F  and 

t 

F  (t)  5  P(X  <t}  =  X/  (l-F(u)  )du  .  (4.1) 

0 

Kalzanov  (1970,  1975a,  1975b)  aimed  to  compare  with  the  most 

"typical"  (?)  of  point  processes,  namely,  he  took  a  Poisson  process 
N2  with  rate  parameter  X  ,  so  that 

p{N2(0,t]  =  k}  =vk(t)  =  (Xt)ke"Xt/k!  .  (4.2) 

His  comparison  was  based  on  the  probabilities  {vk( •) }  and 

pk(t)  =  p{N1(o,t]-k}  =  Hsk^t<sk+1} 

=  /  (F(k-1)*(t-u)  -  Fk*(t-u))dF  (u)  (4.3a) 

0 

=  X/  (F(k_1)*(u)  -  2Fk*(u)  +  F(k+1)*(u))du  , 

0 

provided  k  i  1  ;  for  k  =  0  , 


(A. 3b) 


PQ(t)  =  1  -  Fx(t)  . 


Kalzanov  (1975a)  claimed  that 

5k  "  pl(Pk,vk)  E  8“PlPk^)  "  vk(t)l 


(3  +  4Hn(l/p1))p1 


(k  -  0)  , 


(k  =  1,2,...)  , 


where  P1  =  sup|F(t)  -  F1 ( t) [  (4.5) 

so  that  Pj  =  0  If  and  only  if  F(t)  =  F^(t)  =  1  -  e  ^  and  hence 

is  a  Poisson  process.  He  does  indeed  establish  (4.4)  for  k  =  0,1, 2, 3, 
and  shows  that  sup  |P.  (t)  -  v,  (t)|  is  bounded  as  asserted. 


Xt  <  £n(l/p1) 

but  his  proof  for  Xt  >  Jln(l/p^)  is  erroneous,  being  based  on  the  false 
assertion  that  for  non-negative  r.v.s  X  and  Y  and  a  <  b  , 


"Pr{a  <  X  +  Y  <  b}  s  Pr{a  <  X  <  b}"  . 


Problem  2.  Investigate  whether  the  bounds  at  (4.4)  hold  for  k  >  4 
Can  the  coefficient  of  p^  be  tightened? 


Problem  3.  It  was  also  claimed  by  Kalzanov  (1975a)  that 


\  5 


(k  -  0)  , 


(5  +  2£n(l/Xp2))Xp2  (k  =  1,2,...) 


where  Xp„  =  X/  | F ( t )  -  F, (t)|dt  .  Investigate  whether  these  bounds 
0 

on  6.  hold  for  k  i  3  . 
k 

Since  these  publications  may  not  be  so  readily  accessible, 
an  outline  of  the  (correct)  part  of  their  derivation  is  given  later 


in  this  section  (see  around  (4.15)). 


Kalzanov's  motivation  is  clear  enough;  he  is  comparing 
with  a  Poisson  process  when  the  lifetime  d.f.  F  and  stationary 
forward  recurrence  time  d.f.  F  are  close,  and  hence  F  is  close 
to  the  exponential  d.f.,  because  as  shown  in  Kalzanov  (1970), 

,  t 

F  (t)  -  (1  -  e'At)  =  /  (F  (t-u)  -  F(t-u))Ae_Audu  ,  (4.7) 

0 

SO 

SUP | Fj ( t )  -  (1  -  e  At)|  <  p2(l  -  e"At)  <  P1  ,  (4.8) 

/  | F  (t)  -  (1  -  e_Xt|dt  <:  p  (1  -  e_At)  <  p  ,  (4.9) 

0  L 

and  sup | F(t)  -  ( 1  -  e  At) |  < p^  +  supjF  (t)  -  (1  -  e  At) |  =  2p  . 

t  t  1 

(4.10) 

However,  the  bound  (assumed  true)  is  somewhat  larger  than  is  probably 
likely,  because  it  exceeds  1  for  >  .074778,  as  in  the  table  below 


(3  +  4£n(l/p1))P1 

.01 

.214207 

.02 

.372962 

.03 

.510787 

.04 

.635020 

.05 

.749146 

.06 

.855219 

.07 

.954593 

.074778 

1.0,7 

0 

Suppose  the  lifetime  d.f.  F  has  a  finite  second  moment. 

Lt  may  then  be  of  more  interest  to  compare  the  marginal  probabilities 
or  even  the  simpler  probabilities 
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of  a  renewal  process  N^(‘)  with  F  as  the  d.f.  of  as  well  as 

X„ ,  X  , ....  with  the  corresponding  probabilities  v,  (t)  or 
^  J  k ,  Y 

v  (t)  of  a  stationary  renewal  or  renewal  process  respectively  with 

gamma  distributed  intervals  Y^,  Y^,...  matching  X^,  X^,...  in 

their  first  two  moments.  Then  for  moderate  (to  large)  values  of  k  , 

2 

using  <t>  to  denote  the  standard  normal  d.f.,  and  0  =  var  X  (n  >  2) 

n 

P°(t)  =  <l>((t-kA_1)/(aki5))  -  $((t-(k+l)A-1)/ (cKk+l)^))  ,  (A. 12) 

which  is  possible  for  all  t  i  0  ,  and,  of  course,  then 

P^(t)  58  v^  ^(t)  •  (P^(t)  may  have  discrete  jumps,  but  the  approximation 

will  remain  valid.).  Indeed  it  is  immediately  obvious  that,  provided 

X^  has  a  finite  third  moment,  the  Berry  -  Esseen  bound  may  be  applied  to 

bounding  |P^(t)  -  v^  (t)  |  uniformly  in  t  ,  -*■  0  as  k  -*■  00  like 
k  k,y 

_u 

0(k  )  -  though  large  k  is  needed  before  this  is  necessarily  smaller 


than  one. 


Recognizing  from  (4.3)  that  for  k  11  , 
pk(t)  =  /  P°_1(t-u)dF1(u) 


and  that  P  (t)  =  /  (F  (t)  -  F  (t-u))dF(u)  , 
0 


(4.13) 


another  possible  approach  to  bounding  P^(t)  to  use  the  concentration 

—I5 

function  of  F  which  behaves  like  k  for  increasing  k  (see  section 
2.2  of  Hengartner  and  Theodorescu  (1973)).  Alternatively,  smoothing 
Inequalities  on  transforms  may  be  useful  (cf.  Paulauskas  (1971), 

Petrov  (1975)). 

For  approximation  purposes,  observe  that  when  4>(*)  denotes 
the  standard  normal  probability  density  function, 


sup | <f>( t )  -  a  <J>(t/a)  |  »  (1  -o')/o' 


(4.14) 
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where  o'  =  mln(a,0  . 

Kalzanov's  (1975a)  partial  derivation  of  (4.4)  comes  from 
(4.8)  and  (4.10)  applied  to 

t  t 

Pk(t)  "  \(t)  =  /Q  pk_1(t-u)dF(u)  -  /  vk_1(t-u)dG(u)  (4.15) 

which  holds  for  k  =  2,3,...,  where  we  have  written  G(u)  =  1  -  e 
and,  using  convolution  notation, 

Px(t)  -  vx(t)  =  (Fx-  F*F1)(t)  -  (G-G2*)(t)  . 

(4.7)  can  be  written  as  -  G  *  (F  -  F)*G  .  Then 

pi  -  vi  =  (F  -  F)*G  -  F*F1  +  G*G 
=  (G-F) *(Fj+G)  , 

|P1(t)  -  vx(t)|  <  (Fx  +  2G  +  G2*)Pl  . 

Generally, 


pw  -  Vl  ■  (Pk-vk).F  +  vk.(r-G) 


lpk+1(t)  "  Vt-l^l  5  suPlpk(u)  "  \(u)|  +  (Gk*+  G(k+1)*)*(G°+G)p1 

u^t 


The  coefficient  of 
k  =  1,2,3  .  For  all 
bound  on  pk+^(t)  ~ 


<  P1(p1+  3G  +4G2*+. . .+4Gk*+  3G(k+1)*+  G(k+2)*)(t) 

P^  at  (4.4)  >  12  for  p^  s  .074778  so  it  holds  for 

k  and  finite  t  ,  the  coefficient  of  p^  in  the 


vk+1(t)  is  at  most  P1(F1 (t) -G(t)  + 4At)  <  p1(p1+4At)  . 


Kalzanov  (1975b)  endeavours  to  bound  the  difference 

]pk^(t)  -  pk2^(t)|  of  the  probabilities  pk^(t)  of  stationary 

renewal  processes  (i=l,2)  in  terms  of  the  metric  sup|F^(t)  -  F^2^(t)| 

(i)  C 

on  the  lifetime  d.f.s  F  (•)  ,  assuming  these  to  be  absolutely  continuous 
d.f.s  with  bounded  densities  and  finite  second  moments.  The  argument 


\ 
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resembles  that  outlined  above,  and  has  the  same  appeal  to  the 
erroneous  statement  (*)  . 

v  y 

Azlarov  and  Kalzanov  (1976a)  refers  to  Kalzanov  (1975a) 
in  deriving  bounds  on  the  difference  of  the  stationary  waiting  time 
d.f.  for  a  GI/M/k  from  the  same  d.f.  in  an  M/M/k  queue  with  the  same 
arrival  and  service  rates.  Bounds  are  given  for  each  of  the  cases  of 
an  IFR  and  DFR  inter-arrival  d.f.  in  GI/M/k.  Details  of  the  proof 
are  omitted,  so  it  is  not  clear  whether  (*)  has  been  used.  In 

v 

Azlarov  and  Kalzanov  (1976b)  the  loss  probabilities  in  pure  loss 
GT/M/k  and  M/M/k  systems  are  compared,  but  only  the  abstract  in 
Mathematical  Reviews  is  available. 

While  for  example  the  sequence  {6^}  provides  some 
information  on  all  the  one-dimensional  marginal  distributions  {P^} 
as  compared  with  those  {v^}  of  a  Poisson  process  -  or,  indeed,  we 
could  consider  {6^}  for  any  two  point  processes  via 

{sup | Pr{N^(0, t]=k}  -  Pr{N2(0,t]=k  |  }  , 

we  may  prefer,  as  an  indicator  of  the  "distance"  between  the  processes 
Nj  ,  some  function  that  discounts  behaviour  for  either  large  t  or 
large  k  or  both,  such  as  (for  appropriate  e  >  0  and  z  in 
0  <  z  <  1) 

OU  OO 

1  z~  J  e  Ct|Pr{N  (0,t]=k}  -  Pr{N_(0,t]=k|dt  . 
k=0  0 

Alternatively,  interest  in  large  k  may  be  measured  by  for  example 

sup  k**|P^1)(t)  -  p£2)(t)|  . 
t 

Trivially,  since  there  exist  point  processes  with  distinct 
probability  distributions  whose  finite-dimensional  distributions  agree 
up  to  some  finite  order  r  (cf.  Szasz  (1970)  and  Oakes  (1974)),  no 
single  member  of  {6^}  ,  nor  even  the  entire  sequence,  nor  any  function 


■ 


based  on  finite  dimensional  distributions  of  bounded  order,  will  be  a 

metric  on  the  space  of  point  processes.  Of  course  sup|F^^(t)  -  F^(t)| 

t 

is  a  metric  on  the  space  of  renewal  processes,  as  these  are  characterized 
by  their  lift  time  d.f.s. 

An  entry  m  Mathematical  Reviews  refers  to  Bol'sakov  and 
RakoSic  (1978)  as  having  studied  in  detail  Poisson  and  close-to-Poisson 
point  processes.  The  meaning  of  the  phrase  in  the  context  can  only  be 
guessed  at. 


5.  COMPARABILITY  OF  POINT  PROCESSES 

The  Idea  of  studying  the  distance  of  one  object  from  another. 

Is  an  endeavour  by  implication  to  compare  the  two  objects.  Comparisons 
in  stochastic  analysis  usually  refers  to  the  partial  ordering  of  the 
objects,  and  consideration  of  the  variety  of  definitions  proposed  for 
the  comparability  of  point  processes  may  be  helpful.  Let  -<  denote 
a  partial  ordering  on  the  space  X  of  (real-valued)  r.v.s  on  (f2,F,P): 
Stoyan  (1977)  surveys  some  of  the  ideas  and  properties  of  some  partial 
orderings  on  X  ,  mostly  expressed  in  terms  of  partial  orderings  on 
functions  of  the  probability  measures  Px  induced  on  (fi,F,P)  via 
X  €  X  . 

For  point  processes,  work  of  Schmidt  (1976)  that  Stoyan  reviews 
is  covered  in  Whitt  (1981)  whose  survey  is  the  source  of  the  definitions 
below;  Whitt's  numerical  numbering  of  definitions  is  replaced  by  a  more 
suggestive  notation.  The  definitions  are  interspersed  with  some  comments; 
write  N(0,t]  =  N(t)  for  brevity.  Stoyan  (1977)  has  an  appealing 
terminology:  if  -<  ^  for  some  partial  ordering  -<  on  point  processes, 

say  that  is  S -thinner  than  Nj  ,  or,  equivalently,  that  Nj  is 

X  -thicker  than  . 
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Def Ine 

F(*|«t)  =  Pr{TN(t)+r  t<x|N(s)  ,  0  <  s  <  t)  ,  (5.1) 

the  forward  recurrence  time  d.f.  at  t  conditional  on  the  entire 
history  H  of  N(*)  up  to  time  t  .  Then  say 

Nj  N2  if  F(1)(x|Ht)  <  F(2)(x|Ht)  (5.2) 

holds  for  all  x  >  0  and  all  histories  H  .  In  other  words,  the 
conditional  forward  recurrence  time  is  stochastically  larger  in 
than  for  all  realizations  on  (0,t)  and  for  all  t  . 

In  the  particular  case  that  (say)  is  a  renewal  process 

with  lifetime  d.f.  F  ,  and  N2  is  a  possibly  inhomogeneous  Poisson 
process  with  EN2(0,t]  =  A(t)  ,  (5.2)  implies  that 

sup  (F(u+x) -F(u) ) / (l-F(u) )  <  1  -  e-(A(t+x)-A(t))  <  (5>3) 
0<u<t 

This  condition  is  more  easily  written  via  the  representation,  valid 
for  all  u  for  which  F(u)  <  1  ,  that  F(u)  =  1  -  e  for  some 

non-decreasing  function  p(’)  ,  p(u)  ■*  00  (u-*-°°)  .  Then  (5.3)  is 
equivalent  to 

p(u+x)  -  p(u)  <  A(t+x)  -  A(t)  (all  0  Su  £  t)  , 

and  it  follows  that  A(t+0)  =  00  for  inf{t:  p(t-K))  >  u(t-O)}  if  such 
set  is  non-empty.  This  would  lead  to  a  Poisson  process  exploding  at 
such  t  ,  as  would  be  the  case  also  if  p(x)  -+  00  for  x  -+■  Xq  <  00  . 
Eliminating  these  cases,  we  are  left  with  the  (interesting)  case  that 
A(t)  <  Ct  (all  t)  for  some  finite  constant  C  >  lim  (y (u+v)-p(u) ) /v  = 

VrU 

h(u)  (all  u)  provided  the  limit  exists.  Indeed,  it  suffices  to  write 
m ( t )  =  suPq<u,j  h(u)  ,  and  then  we  may  take 
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t 

A(t)  =  f  m(u)du  . 

0 

This  is  the  smallest  function  A(‘)  satisfying  (5.3);  Miller  (1979) 
also  showed  that  such  a  nonhomogeneous  Poisson  process  can  be  constructed 
so  that  will  bound  the  renewal  process  with  lifetime  d.f. 

x 

F(x)  =  1  -  exp(-  /  h(u)du) 

0 

in  the  sense  that  ^  Nj  .  He  also  shows  that  an  inhomogeneous 
Poisson  process  NQ  with  ENQ(0,t]  -  /  (infg^uSxh(u))dx  satisfies 

N0  *h  Ni  • 

Returning  to  general  point  processes  and  Nj  ,  suppose 

that  their  realizations  satisfy 

N^(x,x+dx)  <.  ^(x.x+dx)  a.s.  (5.4) 

for  all  0  <  x  <  00  ,  i.e.,  every  jump  in  the  counting  function  N^fx.w) 
is  also  a  jump  in  ^(x.u))  ,  and  its  size  in  ^  is  at  least  as  large 
as  in  .  When  (5.4)  is  satisfied,  write 

Nx  C  N2  (5.5) 

since  the  definition  is  precisely  that  the  sets  }  as  defined  by 

(3.1)  satisfy  such  an  inclusion  relation.  If  is  obtained  from  Nj 

by  any  thinning  operation,  then  clearly  C  N  . 

If  N2  ,  then  (there  exists  a  common  probability  space 

* 

on  which  and  may  be  defined  such  that)  ^  *  but  t^e 

converse  need  not  hold.  However,  if  C  Nj  and  both  are  Poisson 

processes,  then  the  converse  will  hold,  because  the  intensity  measures 
A^  will  satisfy  A^(A)  s  ^(.A)  for  all  bounded  Borel  sets  A  ,  and  for 

*  /- 
This  parenthesized  remark  Is  to  be  understood  in  defining  N.  CNN  <  N 
and  s  pN2  .  1-21  int 


Inhomogeneous  Poisson  processes,  F(x|Ht)  =  1  -  exp(-A(t,t+x]) 
independent  of  H  .  If  both  are  doubly  stochastic  Poisson 

processes  for  which  the  sample  realizations  of  the  intensity  functions 
satisfy  A^(A,w)  5  a.s.  for  all  Borel  sets  A  ,  then  while 

we  have  C  ,  we  need  not  have  because  the  "history" 

H  i  {^(s)  :  0  <  s  <  t}  is  not  equivalent  to  A^(  •  ,to)  .  This  statement 

could  be  rephrased  in  measure-theoretic  language,  but  an  illustration 
is  probably  worth  more  in  word-value:  let  A^(*,u))  have  the  densities 
A^C^.co)  given  by 

0  for  t  £  1  ,  2  for  t  >  1  with  probability  .5, 

A,(t)  -  • 

2  for  1  <  t  £  2  ,  1  otherwise  with  probability  .5, 

2  for  all  t  with  probability  .5, 

A„(t)  »  • 

[2  for  t  £  2  ,  1  for  t  >  2  with  probability  .5. 

Then  Pr{N1(2,x]  -  01^(0,21-0}  -  (e-2(x-2)+  e-1e~(x'2) ) / (1+e-1) 
Pr{N2(2,x]  =  0|N2(0,2]-0}  -  (e'2(x_2)+  e~(x_2))/2  , 

so  that  F^  ( x S (0 , 2 ]  -  0)  >  F^  (x]N2(0,2]-0)  ,  contra  (5.2)  if  we  were 

to  have  N,  £,  . 

I  h  i 

Particularly  as  inputs  to  queueing  systems,  there  is  much 

interest  in  the  intervals  (X  }  following  (3.1).  For  N.  defined  on  a 

n  l 

common  probability  space,  say  that 

N.  £,  N.  if  X(1)  SX^2)  (all  n  -  1,2,...)  a.s.  (5.6) 
l  int  i  n  n 

In  other  words,  the  points  of  are  more  spaced  out  than  those  of  N2  . 

If  are  renewal  processes  with  lifetime  d.f.s  F  ,  G  for 

which  F(x)  £  G(x)  (all  x)  (in  the  language  of  Stoyan,  the  d.f.  F  is 
larger  than  G)  ,  then  there  are  realizations  }  for  which  (5.6)  is 
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necessarily  satisfied.  It  need  not  be  the  case  that  if  C  ^  , 

then  ^nt  ^2  *  nor  converse^y«  although  if  are  renewal 

processes  satisfying  C  ^  ,  then  there  will  be  renewal  processes 

N'  distributed  like  N  for  which  N'  £  N'  .  In  terms  of  models 
i  ll  int  2 

for  point  processes,  the  ordering  s  ^  arises  naturally  only  when 
the  process  is  conveniently  specified  by  its  intervals  (cf.  also  the 
comments  in  section  3) . 

It  will  be  evident  that  all  three  orderings  presented  so 
far  have  the  property  of  implying  that  -<  yields 

N^O.t]  <  N2(0,t]  (all  t)  a.s. ,  (5.7) 

and  when  (5.7)  holds,  we  shall  say  that 

N1  <p  N2  .  (5.8) 

To  justify  the  notation  as  suggesting  that  some  underlying  probabilistic 
inequality  may  suffice,  recall  the  equivalence  of  events 

{n^(0,Xj  ]  i  (j  ■  1, . . .  ,k) }  *  (S^  21  xj  (j  “  l,...,k)}  , 
and  that  the  multivariate  analogue  of  the  inequality  X  Y  between 
r.v.s  X  and  Y  is  that 

Ef(Xx . Xk)  S  Ef(Y1,...,Yk)  (5.9) 

for  all  functions  f  increasing  in  each  argument  such  that  the 
expectations  exist.  If  for  all  such  f  we  have 

Ef({S(1)})  2  Ef({S<2)})  (5.10) 

n  n 

then  by  an  extension  of  a  result  of  Strassen  (see  Chapter  17  of  Marshall 
and  Olkin  (1979),  or,  for  more  detail,  Kamae,  Krengel  and  O'Brien  (1977)) 
there  is  a  probability  space  on  which 
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s^1)  2  S^2)  (all  n)  a. s.,  (5.11) 

and  hence  (5.7)  holds  also. 

Since  (5.11)  for  n  ■*  1  Implies  that  a.s., 

it  follows  Immediately  that  for  renewal  processes,  ^ p  N2  *-mPlies 

-int  N2  *  ^ut  this  result  need  not  be  true  in  general.  For  example, 
may  be  a  renewal  process  with  lifetime  d.f.  F  ,  and  ^  an 
alternating  renewal  process  with  lifetime  d.f.s  and  for  which 

for  all  x  ,  G^(x)  2  F(x)  £  G^(x)  and 

. x  2* 

J  G  (x-u)d  G_(u)  2  F  (x)  ;  this  is  an  easy  construction 
0  1 

(take  F(x)  =  G2(x+a)  ,  G^(x)  =  G2(x+a+b)  for  0  <  b  <  a)  . 

The  last  inequality  Whitt  lists  is  just  the  marginal 
distribution  property  that 


N1(t)  Sd  N2(t)  (all  t)  . 


(5.12) 


The  quasi-Poisson  processes  of  Szasz  (1970)  or  Oakes  (1974)  afford 

simple  examples  of  processes  satisfying  <d  Nj  but  none  of  the 

other  partial  orderings.  (As  Whitt  notes,  (5.12)  is  not  in  fact  a 

partial  ordering  on  the  space  of  point  processes,  because,  as  for 

example  with  the  quasi-Poisson  processes,  we  can  have  N,  N„  and 

1  d  L 

N2  ^d  N1  wit^out  having  a  common  (joint)  distribution.)  Note 

that  if  (5.12)  holds,  then,  by  the  equivalence  as  below  (5.8), 

S(1)  s  S(2)  (all  n)  . 
n  d  n 


Schmidt  (1976)  formulated  the  definition  (5.12),  unnecessarily 
restricted  to  stationary  point  processes,  and  also  formulated  a 
distributional  version  of  for  stationary  point  processes  via  the 

inequality 


E0f({XjJ1)})i  EQf  ({X^2) }) 


(5.13) 
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with  f  as  at  (5.13)  and  Eq  denoting  expectation  with  respect  to 
the  Palm  probabilities,  for  which  }  are  then  stationary  sequences. 

By  the  extension  of  the  Strassen  result,  there  then  exist  point  processes 
N*?  for  which  £int  N2  *  these  processes  having  the  Palm  distribution 
of  the  stationary  processes  . 

Note  that  if  N^  are  renewal  processes  for  which  N  , 

then  since 

PdN^t)  =  0}  ;>  Pr{N2(t)  =  0}  , 

we  must  also  have  <  N2  .  But  if  the  N^  are  stationary  renewal 

processes,  neither  <  nor  need  imply  the  other,  as  Schmidt 

showed . 

In  subsequent  work,  Whitt  (1981b)  has  taken  a  more  pragmatic 
view  and  compared  some  point  processes  numerically  by  studying  how 
different  processes  may  have  different  effects  on  a  queueing  system 
when  fed  as  inputs  into  the  system.  More  work  of  this  nature  has  been 
done  by  Whitt  and  his  colleagues. 


6.  DISTANCES  BETWEEN  POINT  PROCESSES 

For  the  time  being  we  pass  over  the  comparisons  and  C 

for  suggesting  distances  between  point  processes.  Coming  to  -^nt  * 
and  recalling  (2.3),  we  could  use 

OO 

d  „  . (N.  ,N_)  = sup  n-1/  |Pr(S(1)  > t}  -Pr {S ^2)  > t)  |dt  (6.1) 

lnt’1  1  2  nil  0  "  n 

where  the  factor  n  ^  has  been  introduced  to  average  out  the  effect  of 
S^^-  S<2)  being  asymptotically  like  n(EX^  -  EX^ )  if  the  sequences 
{X^  }  are  stationary.  However,  if  N,  S  N0  and  N„  s.  N,  ,  as  at 
(5.11)  and  below,  we  should  have  dint ,i^ni*n2)  =  0  ,  for  (6.1)  depends 
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only  on  the  marginal  distributions  of  N^^(t)  ,  not  the  joint 
distribution  over  a  set  of  values  of  t  • 

d  (N.,N_)  sup ( EN  (t)  -  EN  (t) [ / (t+1)  (6.2) 

E  1  2  t>0  1  2 

has  a  similar  drawback.  However 


dp.*  ( Ni  »  )  -  sup  E  |  N  (t)  -  N  (t)  |  /  (t+1)  (6.3) 

t>0 

does  not  have  this  drawback:  instead  we  are  confronted  with  the 
problem  of  requiring  and  Nj  to  be  defined  on  the  same 

probability  space,  and,  as  noted  in  section  2,  the  appropriate 
construction  is  far  from  evident  as  soon  as  we  dispense  with  renewal 
processes.  As  an  alternative  to  (6.3),  and  one  that  is  better  suited 
to  processes  constructed  by  the  interval  properties,  we  have 


“indW  5  n-^ls'”-  S<2) 

n>l 


(1)*  (2)* 

For  renewal  processes,  defined  via  sequences  {(X  ,  X  )} 


as  in  section  3,  d.  =  d.  .  ,  ,  although  the  proof  is  not  immediately 
int  lnt,i 

obvious . 


Since  renewal  processes  N^  are  characterized  by  their 
renewal  functions  U^(*)  ,  we  could  use,  as  an  alternative  to  (6.2) 
(but  only  for  renewal  processes)  the  function 


sup | U. (t)  -  U  (t) | / (t+1)  .  (6.5) 

t>0 

Matthes,  Kerstan  and  Mecke  (1978)  (e.g.  in  their  Sections 
1.9  and  1.12)  use  the  variation  distance  for  point  processes,  and 
T.C.  Brown  (private  correspondence)  has  written  of  using  compensators 
to  obtain  total  variation  results  for  the  distance  of  point  processes 


\ 
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from  Poisson  processes.  I  have  been  told  of  an  unpublished  review  by 
R.L.  Farrell  that  may  have  relevance  to  this  section.  Mark  Brown  (1981 
and  correspondence)  has  compared  renewal  processes  with  decreasing 
failure  rate  (DFR) :  in  the  notation  of  section  2,  he  has  shown  that 
for  distributions  with  the  weaker  property  of  increasing  mean  residual 
life, 

max(p1(F,F1)  ,  p^F.G)  ,  P^F.G))  <  1  -  2(EX)2/EX2  ;  (6.6) 

for  DFR  d.f.s  it  is  easily  checked  from  a  sketch  of  the  tails  of  the 
d.f.s  involved  and  the  results  of  section  2,  that  the  maximum  on  the 
left-hand  side  of  (6.6)  is  in  fact  p^(F,F^)  .  He  has  also  studied 
metrics  in  terms  of  the  hazard  functions  being  close. 

We  have  not  attempted  to  assess  the  effect  of  common 
operations  on  point  processes  (thinning,  superposition,  translation, 
cluster-formation,  etc.)  on  the  distance  functions  given  above. 
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